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(54) Image correction apparatus and image pickup apparatus 



(57) The present invention relates to an image cor- 
rection apparatus and an image pickup apparatus for 
detecting a particular eye-related defect, such as red- 
eyes and gold-eyes, in an image, and correcting the de- 
tected defect. The present invention provides an image 
correction apparatus and an image pickup apparatus 
enabling a particular eye-related defect, such as a red- 
eye portion or a gold-eye portion, in an image to be eas- 
ily confirmed. The number of positions in an image at 



which a particular eye-related defect, such as a red-eye 
portion and a gold-eye portion, has been detected is dis- 
played together with an image including the positions. 
By displaying the number of positions at which a defect 
has been detected, the number of unconfirmed posi- 
tions can be easily recognized and the defect of over- 
looking the unconfirmed positions can be prevented. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image cor- 
rection apparatus and an image pickup apparatus for 
detecting a particular eye-related defect, such as red- 
eyes and gold-eyes, in an image, and correcting the de- 
fect. 

Description of the Related Art 

[0002] Traditionally, there has been known a camera 
provided with a flashing device with an emitting section 
which emits a flash. Eyes of persons and animals have 
a structure in which, at a dark place, pupils are opened 
large so that more light can be introduced thereinto. 
Therefore, when a person or animal with the pupils 
opened large is photographed at a dark place with the 
use of a flashing device provided for a camera, a flash 
emitted by the emitting section of the flashing device 
may enterthe eyeballsthrough the widely opened pupils 
and reflected by capillaries of retinae covering the inter- 
nal surface of the eyeballs, and as a result, a so-called 
red-eye phenomenon may be caused, in which the pu- 
pils of the person or animal are reproduced in red. There 
may also be a case where, when a picture is taken with 
the use of a flashing device provided for a camera, a so- 
called gold-eye phenomenon may be caused, in which 
pupils of a person or animal may be reproduced as whit- 
ish ones due to reflection of a flash by the sclerae or 
corneae covering the outermost layer of the eyeballs, 
depending on the incidence with which the flash emitted 
by the flashing device enters. 

[0003] With the recent development of digital 
processing techniques, there have been proposed an 
image processing apparatus or an electronic camera 
that acquires image data representing a picture in which 
the pupils of a person or animal are reproduced in red 
or reproduced as whitish ones, detects red-eye portions 
and gold-eye portions in an image represented by the 
acquired image data, and corrects the detected red-eye 
portions and gold-eye portions (see Patent Document: 
Japanese Patent Laid-Open No. 2000-305141 for ex- 
ample). 

[0004] The electronic camera proposed in the above- 
mentioned patent document, which focuses an image 
of a photographed object onto a charge coupled device 
(CCD) solid-state image pickup element to acquire im- 
age data representing the photographed object as a sig- 
nal, is provided with a function of an image processing 
apparatus of detecting red-eye portions in an image of 
a photographed person or animal to correct the detected 
red-eye portions. Furthermore, the electronic camera 
proposed in the above-mentioned patent document is 
provided with an image display device for displaying an 



image, and there is displayed an image, in which eyes 
of a person or animal are reproduced as red-eyes, on 
the image display device when red-eye portions are de- 
tected. Based on the display, the user, such as the pho- 

5 tographer of the image, confirms the red-eye portions in 
the image acquired by photographing and determines 
whether or not to correct the red-eye portions. When 
correction of the red-eye portions is specified as a result 
of the determination, there is displayed an image in 

10 which the red-eye portions have been corrected on the 
image display device, and thereby the user confirms 
whether or not the correction has been accurately per- 
formed. 

[0005] Thus, in the electronic camera proposed in the 
15 above-mentioned patent document, the user is required 
to perform confirmation twice, that is, when the red-eye 
portions have been detected and when the detected 
red-eye portions have been corrected. This is trouble- 
some and time-consuming for the user. 
20 [0006] The screen of an image display device provid- 
ed for an electronic camera is generally small. It is diffi- 
cultto visually confirm red-eye portions using the image 
display device with such a small screen and the red-eye 
portions may be overlooked. 
25 [0007] As means for solving these problems, there is 
known means for facilitating visual confirmation of red- 
eye portions by zooming red-eye portions in an image 
displayed on the image display device. However, in the 
case of an image in which multiple eyes are reproduced 
30 as red-eyes, the confirmation work is troublesome. 

[0008] The above problems are not limited to the filed 
of cameras and photographs and are generally caused 
in the image processing field, for example, in the case 
of performing image processing for any image such as 
35 an image acquired from the Web. 

SUMMARY OF THE INVENTION 

[0009] In consideration of the above situation, the ob- 
40 ject of the present invention is to provide an image cor- 
rection apparatus and an image pickup apparatus that 
enable a particular eye-related defect, such as red-eye 
portions and gold-eye portions in an image, to be easily 
confirmed. 

45 [0010] A first image correction apparatus of the 
present invention to achieve the object is provided with: 

an image acquisition section that acquires image 
data representing an image; 
50 a correction section that detects a particular eye- 

related defect in the image represented by the im- 
age data acquired by the image acquisition section 
and corrects the detected defect; and 
an image display section that displays the number 
55 of positions at which the defect has been detected 
by the correction section, together with the image 
including the positions. 



25 



30 



35 



40 



45 



50 



2 



3 



EP 1 429 290 A2 



4 



[0011] In the first image correction apparatus of the 
present invention, the number of positions at which a 
particular eye-related defect, such as red-eye portions 
and gold-eye portions, has been detected in an image 
is displayed together with the image before correction 
of the defect by the correction section, which includes 
the positions, or the image after correction of the defect 
by the correction section. Therefore, even in an image 
in which multiple eyes are reproduced as red-eyes, the 
defect can be easily confirmed without overlooking any 
defect position by referring to the displayed number of 
the positions. 

[0012] In the first image correction apparatus of the 
present invention, it is preferable that the correction sec- 
tion not only detects the defect in the image but also 
prioritizes the positions at which the defect has been 
found based on a predetermined criteria; and that 

the image display section, when displaying the im- 
age, displays in preference a position to which a 
higher priority has been given by the correction sec- 
tion. 

[0013] For example, by giving a higher priority to a 
photographed object located in the center of the angle 
of view or photographed with the face portion zoomed 
and giving a lower priority to other photographed ob- 
jects, it is possible to confirm a main photographed ob- 
ject in preference and omit the confirming of unneces- 
sary photographed objects such as passers-by. 
[0014] In the first image correction apparatus of the 
present invention, it is preferable that the image display 
section, when displaying the image, displays a list of the 
positions. 

[0015] The preferable image correction apparatus 
makes it possible to confirm the positions at which a de- 
fect has been found at a time. 

[0016] In the first image correction apparatus of the 
present invention, it is preferable that the image display 
section, when displaying the image, zooms at least one 
of the positions. 

[0017] If the number of positions in an image, at which 
a particular eye-related defect has been detected, is dis- 
played together with the image in which at least one of 
the positions is zoomed as described above, the defect 
can be confirmed more easily. 

[0018] In the first image correction apparatus of the 
present invention, it is preferable that the image display 
section, when displaying the image, displays a normal 
image in which none of the positions is zoomed and a 
zoomed image in which one of the positions is zoomed. 
[0019] The preferable image correction apparatus 
makes it possible to confirm details and locations of the 
positions at which a defect has been detected while con- 
firming the whole normal image. 

[0020] It is preferable that the first image correction 
apparatus of the present invention is provided with a 
confirmation section that receives an operation for con- 



firmingthe positions in the image displayed by the image 
display section, at which the defect has been detected 
by the correction section; and that 

5 the image display section, when displaying the 

number of the positions, displays the number of the 
positions minus the number of positions confirmed 
by the confirmation section. 

w [0021] The image correction apparatus provided with 
such a confirmation section in which the number of the 
positions minus the number of confirmed positions is 
displayed makes it possible, even if any position of the 
particular eye-related defect in the image is overlooked, 

15 to certainly confirm the defect by referring to the number 
of positions. 

[0022] In the first image correction apparatus of the 
present invention, it is more preferable that the correc- 
tion section detects red-eye portions in the image and 

20 corrects the detected red-eye portions. 

[0023] Though a red-eye gives a psychologically un- 
comfortable feeling especially strongly among particular 
eye-related defects, they are difficult to visually recog- 
nize. Therefore, such an image correction apparatus 

25 that facilitates confirmation of correction of red-eye por- 
tions in an image is especially useful. 
[0024] In the first image correction apparatus of the 
invention, the image display section may display the 
number of eyes in which the defect has been detected 

30 by the correction section as the number of positions de- 
scribed above. Alternatively, the image display section 
may display the number of persons in which the defect 
has been detected by the correction section as the 
number of positions described above. 

35 [0025] A second image correction apparatus of the 
present invention to achieve the object is provided with: 

an image acquisition section that acquires image 
data representing an image; 
40 a correction section that detects an eye-related de- 

fect in the image represented by the image data ac- 
quired by the image acquisition section and corrects 
the detected defect; and 

an image display section that displays an image 
45 based on the image data; wherein 

the image display section, when the image data is 
acquired by the image acquisition section, displays 
a corrected image in which the defect has been cor- 
rected by the correction section. 

50 

[0026] The second image correction apparatus of the 
present invention detects an eye-related defect in an im- 
age, corrects the detected defect and displays a correct- 
ed image in which the defect has been corrected. There- 
55 fore, the detected defect and the corrected defect can 
be confirmed with the use of the corrected image simul- 
taneously at one time, and confirmation of the eye-re- 
lated defect in the image can be realized by an easy 
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operation. 

[0027] In the second image correction apparatus of 
the present invention, it is preferable that the correction 
section not only detects the defect in the image but also 
prioritizes the positions at which the defect has been 
found based on a predetermined criteria; and that 

the image display section, when displaying the cor- 
rected image, displays in preference a position to 
which a higher priority has been given by the cor- 
rection section. 

[0028] For example, by giving a higher priority to a 
photographed object located in the center of the angle 
of view or photographed with the face portion zoomed 
and giving a lower priority to other photographed ob- 
jects, it is possible to confirm a main photographed ob- 
ject in preference and omit the confirming of unneces- 
sary photographed objects such as passers-by. 
[0029] In the second image correction apparatus of 
the present invention, it is preferable that the image dis- 
play section, when displaying the corrected image, dis- 
plays a list of the positions at which the defect has been 
detected by the correction section. 
[0030] By displaying the list of the positions at which 
the defect has been detected, the positions at which the 
defect has been detected can be confirmed at a time. 
[0031] In the second image correction apparatus of 
the present invention, it is preferable that the image dis- 
play section, when displaying the corrected image, dis- 
plays a normal image in which none of the positions at 
which the defect has been detected by the correction 
section is zoomed and a zoomed image in which one of 
the positions is zoomed. 

[0032] The preferable image correction apparatus 
makes it possible to confirm details and locations of the 
positions at which a defect has been detected while con- 
firming the whole normal image. 

[0033] It is preferable that the second image correc- 
tion apparatus of the present invention is provided with 
a correction deletion section that restores the defect cor- 
rected by the correction section, in the corrected image 
displayed by the image display section, to the original 
condition held before the defect is corrected by the cor- 
rection section. 

[0034] The image correction apparatus provided with 
such a correction deletion section can restore the cor- 
rected image to the original condition before a defect 
was corrected when detection or correction of the defect 
by the correction section is inappropriate. 
[0035] In the second image correction apparatus of 
the present invention, it is also preferable that the image 
display section, when displaying the corrected image, 
emphasizes the defect corrected by the correction sec- 
tion. 

[0036] If the eye-related defect in the corrected image 
is emphasized, the eye-related defect in the image can 
be confirmed more easily. 



[0037] In the second image correction apparatus of 
the present invention, it is more preferable that the cor- 
rection section detects red-eye portions in the image 
and corrects the detected red-eye portions; and that 

5 

the image display section, when the image data is 
acquired by the image acquisition section, displays 
a corrected image in which the red-eye portions 
have been corrected by the correction section. 

10 

[0038] Though red-eye gives a psychologically un- 
comfortable feeling especially strongly among particular 
eye-related defects, the red-eyes are difficult to visually 
recognize. Therefore, such an image correction appa- 
15 ratus that facilitates confirmation of correction of red- 
eye portions in an image is especially useful. 
[0039] A first image pickup apparatus of the present 
invention to achieve the object is: 

20 an image pick up apparatus that forms a photo- 
graphed object image by light of the photographed 
object sent via a photographing optical system onto 
a solid-state image pickup element to acquire im- 
age data representing the photographed object im- 
25 age; the image pick up apparatus including: 

a correction section that detects a particular 
eye-related defect in the photographed object 
image and corrects the detected defect; and 
30 an image display section that displays an image 

including positions at which the defect has been 
detected by the correction section and displays 
the number of the positions at which the defect 
has been detected. 

35 

[0040] As described above, though the screen of an 
image display device provided for an image pickup ap- 
paratus is generally small. However, if the number of po- 
sitions in a photographed object image at which a par- 
40 ticular eye-related defect, such as red-eye portions and 
gold-eye portions, has been detected is displayed, to- 
gether with the image before correction of the defect by 
the correction section, which includes the positions, or 
the image after correction of the defect by the correction 
45 section, as in the image pickup apparatus of the present 
invention, then, even in the case of an image in which 
multiple eyes are reproduced as red-eyes, it is possible 
to easily confirm the defect without overlooking any de- 
fect position by referring to the displayed number of the 
50 positions. 

[0041] In the first image pickup apparatus of the 
present invention, it is preferable that the image display 
section, when displaying the image, zooms at least one 
of the positions. 
55 [0042] It is also preferable that the first image pickup 
apparatus of the present invention is provided with a 
confirmation section that receives an operation for con- 
firming the positions in the image displayed by the image 
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display section, at which the defect has been detected 
by the correction section; and that 

the image display section, when displaying the 
number of the positions, displays the number of the 
positions minus the number of positions confirmed 
by the confirmation section. 

[0043] In the first image pickup apparatus of the 
present invention, it is more preferable that the correc- 
tion section detects red-eye portions in the image and 
corrects the detected red-eye portions. 
[0044] Furthermore, in the first image pickup appara- 
tus of the present invention, the image display section 
may display the number of eyes in which the defect has 
been detected by the correction section as the number 
of the positions described above. Alternatively, the im- 
age display section may display the number of persons 
in which the defect has been detected by the correction 
section as the number of positions described above. 
[0045] A second image pickup apparatus of the 
present invention to achieve the object is: 

an image pickup apparatus that forms a photo- 
graphed object image by light of the photographed 
object sent via a photographing optical system onto 
a solid-state image pickup element to acquire im- 
age data representing the photographed object im- 
age; the image pickup apparatus including: 

an image display section that displays an image 

based on image data; and 

a correction section that detects an eye-related 

defect in the photographed object image and 

corrects the detected defect; wherein 

the image display section, when the image data 

representing the photographed object image is 

acquired, displays a corrected image in which 

the defect has been corrected by the correction 

section. 

[0046] As described above, the screen of an image 
display device provided for an image pickup apparatus 
is generally small. However, if an image pick apparatus 
detects an eye-related defect in a photographed object 
image, corrects the detected defect, and displays the 
image in which the defect has been corrected, as the 
second image pickup apparatus of the present inven- 
tion, it is possible to confirm the detected defect and the 
corrected defect simultaneously at one time with the use 
of the corrected image. Furthermore, though operation- 
al ity of switches provided for an image pickup apparatus 
are generally not good, red-eye portions are confirmed 
with the use of the corrected image in which the defect 
has been corrected, in the second image pickup appa- 
ratus of the present invention, and accordingly, the 
number of operations for confirmation is reduced, and 
therefore the defect in eyes in an image can be easily 



confirmed even with a low-operationality switch. 
[0047] In the second image pickup apparatus of the 
present invention, it is preferable that the correction sec- 
tion not only detects the defect in the image but also 
5 prioritizes the positions at which the defect has been 
found based on a predetermined criteria; and that 

the image display section, when displaying the cor- 
rected image, displays in preference a position to 
10 which a higher priority has been given by the cor- 
rection section. 

[0048] By giving a priority to positions at which a de- 
fect has been found, it is possible to efficiently perform 

15 confirmation. 

[0049] In the second image pickup apparatus of the 
present invention, it is preferable that the image display 
section, when displaying the corrected image, displays 
a list of the positions at which the defect has been de- 

20 tected by the correction section. 

[0050] By displaying the list of positions at which the 
defect has been detected, it is possible to confirm the 
positions at which the defect has been detected at a 
time. 

25 [0051] In the second image pickup apparatus of the 
present invention it is preferable that the image display 
section, when displaying the corrected image, displays 
a normal image in which none of the positions at which 
the defect has been detected by the correction section 

30 is zoomed and a zoomed image in which at least one of 
the positions is zoomed. 

[0052] The preferred image pickup apparatus makes 
it possible to confirm the whole image by a normal image 
and details and locations of the positions at which a de- 

35 feet has been detected simultaneously at one time. 
[0053] It is preferable that the second image pickup 
apparatus of the present invention is provided with a cor- 
rection cancellation section that restores the defect cor- 
rected by the correction section, in the corrected image 

40 displayed by the image display section, to the original 
condition held before the defect is corrected by the cor- 
rection section depending on operations. 
[0054] The image pickup apparatus provided with 
such a correction cancellation section makes it possible, 

45 jf detection or correction of a defect by the correction 
part is inappropriate, to restore the corrected defect to 
the original condition before correction of the defect. 
[0055] In the second image pickup apparatus of the 
present invention, it is preferable that the image display 

50 section, when displaying the corrected image, empha- 
sizes the defect corrected by the correction section. 
[0056] If an eye-related defect in a corrected image is 
emphasized as described above, the eye-related defect 
in the image can be confirmed more easily. 

55 [0057] A third image pickup apparatus of the present 
invention to achieve the object is provided with: 

an image pickup section that forms a photographed 
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object image by light of the photographed object 
sent via a photographing optical system onto a sol- 
id-state image pickup element to acquire image da- 
ta representing the photographed object image; 
a photographing condition acquisition section that 5 
acquires photographing conditions in photograph- 
ing an object to be photographed; and 
a presumption section that makes a presumption on 
whether or not a particular eye-related defect is to 
occur in the photographed object image represent- 10 
ed by the image data acquired by the image pickup 
section, based on the photographing conditions ac- 
quired by the photographing condition acquisition 
section. 



[0058] By making a presumption in advance on 
whether or not a particular eye-related defect will occur 
in a photographed object image, it is possible to certainly 
perform confirmation if it occurs and save the trouble of 
confirmation if it does not occur. 

[0059] It is preferable that the third image pickup ap- 
paratus of the present invention is further provided with 
a flash emitting section that emits a flash in synchroni- 
zation with photographing performed by the image pick- 
up section; and 

a control section that controls emission performed 
by the flash emitting section based on the result of 
the presumption by the presumption section. 

[0060] When it is presumed that a particular defect will 
occur in an image to be photographed, occurrence of 
the defect can be reduced by, for example, adjusting the 
emission strength of the flash emitting section. 
[0061] It is also preferable that the third image pickup 
apparatus of the present invention is further provided 
with a correction section that detects the particular eye- 
related defect in the photographed object image and 
corrects the detected defect when it is presumed by the 
presumption section that the defect is to occur. 
[0062] When it is presumed that a defect will occur in 
a photographed image, it is possible to acquire a visually 
desirable image having no defects has not occurred by 
detecting and correcting the defect in the photographed 
object image. 

[0063] Alternatively, it is preferable that the third im- 
age pickup apparatus of the present invention is further 
provided with a warning section that issues a warning 
indicating that the defect is to occur when it is presumed 
by the presumption section that the defect is to occur. 
[0064] By receiving a warning indicating that a defect 
will occur, a photographer can prevent the defect from 
occurring by, for example, changing the distance to the 
object to be photographed when photographing the ob- 
ject. 

[0065] It is also preferable that the third image pickup 
apparatus of the present invention is further provided 
with a flash emitting section that emits a flash; 



the image pickup section acquires first image data 
by avoiding the flash emitted by the flash emitting 
section and acquires second image data in syn- 
chronization with the flash emitted by the flash emit- 
ting section; and that 

the presumption section is provided with a defect 
detection section that compares colors in a first im- 
age represented by the first image data and colors 
in a second image represented by the second im- 
age data and considers the defect to have occurred 
at positions at which the colors are different to the 
degree equal to or exceeding a predetermined lev- 
el. 

15 [0066] Particular eye-related defects, such as red- 
eyes, are usually caused by a flash emitted by the flash 
emitting section. Accordingly, by comparing colors in a 
first image acquired without a flash, in which the defect 
has not occurred, and colors in a second image acquired 

20 with a flash and considering thatthe defect has occurred 
at positions where the colors are different to the degree 
equal to or exceeding a predetermined level, it is possi- 
ble to easily detect the defect in a photographed image. 
[0067] According to the present invention, there can 

25 be provided an image correction apparatus and an im- 
age pickup apparatus that enable easy confirmation of 
particular eye-related defects such as red-eyes and 
gold-eyes in an image. 



30 BRIEF DESCRIPTION OF THE DRAWINGS 
[0068] 

Fig. 1 is an external perspective view of a camera 
35 according to a first embodiment of the present in- 
vention when it is seen obliquely downwardly from 
the front; 

Fig. 2 is an external perspective view of the camera 
shown in Fig. 1 when it is seen obliquely downward- 
40 |y from the back; 

Fig. 3 is a configuration block diagram of a signal 
processing section arranged inside the camera 
shown in Figs. 1 and 2; 

Fig. 4 is a flowchart showing an operational flow 
45 when a "first automatic red-eye correction process- 
ing" mode is selected; 

Fig. 5 shows an example of an image photographed 
at step S101; 

Fig. 6 shows a display example wherein there are 
50 displayed a red-eye corrected image for which an 

automatic red-eye correction processing has been 
performed at step S104 and the number of uncon- 
firmed positions on a LCD panel; 
Fig. 7 shows display examples different from Fig. 6, 
55 wherein there are displayed a red-eye corrected im- 
age and the number of unconfirmed positions; 
Fig. 8 shows a display example wherein there is dis- 
played a red-eye corrected image, on which a face 
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can be selected with a cross key at step S106, on 
a LCD panel; 

Fig. 9 shows display examples different from Fig. 8 
wherein there are displayed red-eye corrected im- 
ages on which a face can be selected at step S1 06; 
Fig. 10 shows a display example wherein a face 
zoomed at step S1 07 is displayed on a LCD panel; 
Fig. 11 shows display examples different from Fig. 
1 0 wherein a zoomed face is displayed; 
Fig. 12 shows a display example wherein an eye 
portion zoomed at step S109 is displayed on a LCD 
panel; 

Fig. 13 is a flowchart showing an operational flow 
when a "second automatic red-eye correction 
processing" mode is selected; 
Fig. 14 shows a display example wherein there are 
displayed a red-eye corrected image for which au- 
tomatic red-eye correction processing is performed 
at step S204 and the number of detections on a LCD 
panel; 

Fig. 15 shows a display example wherein a face 
zoomed at step S207 and the number of uncon- 
firmed positions are displayed on a LCD panel; 
Fig. 16 shows a display example wherein an eye 
portion zoomed at S209 and the number of uncon- 
firmed positions are displayed on a LCD panel; 
Fig. 17 is a flowchart showing a series of process- 
ings from photographing of an object with a camera 
according to a second embodiment to storage of a 
photographed image; and 

Fig. 18 is a flowchart showing a series of process- 
ings from photographing of an object with a camera 
according to athird embodiment to storage of a pho- 
tographed image. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0069] Embodiments according to the present inven- 
tion will be described below. 

[0070] There will be described embodiments wherein 
the present invention is applied to an electronic camera 
in which an image of a photographed object is focused 
on a charge coupled device (CCD) solid-state image 
pickup element to acquire image data representing the 
photographed object as a signal. 

[0071] Fig. 1 is an external perspective view of an 
electronic camera according to one embodiment of the 
present invention when it is seen obliquely downwardly 
from the front. A general configuration of an electronic 
camera will be described first with reference to Figs. 1 
to 3. An electronic camera according to this embodiment 
as the present invention is characterized in the process- 
ing operation in a "first automatic red-eye correction 
processing" mode and a "second automatic red-eye cor- 
rection processing" mode, which is to be described later 
in detail. 

[0072] A camera 100 shown in Fig. 1 is a camera for 



photographing a picture onto a photograph film not 
shown. 

[0073] At the front of the camera 1 00, there is provid- 
ed a lens barrel 101 with an image taking lens 101a pro- 

5 vided therein. The image taking lens 101a focuses the 
light of a photographed object incident thereto, onto the 
photographing surface of a CCD solid-state image pick- 
up element (not shown) arranged inside the camera, 
and image data representing the photographed object 

10 is generated by the CCD solid-state image pickup ele- 
ment. 

[0074] At the front of the camera 100, there are pro- 
vided a flash emitting device 1 03, a dimming sensor 1 02 
for measuring the quantity of light emitted by the flash 

15 emitting device 1 03, a self timer LED 1 1 5 for lighting up 
to inform start of photographing to an object to be pho- 
tographed, and an optical finder objective window 104a 
to be looked into by a photographer to determine the 
position of the object to be photographed. The flash 

20 emitting device 103 is an example of a flash emitting 
section according to the present invention. 
[0075] At the right end on the upper surface of the 
camera 100, there is provided a shutter release button 
105 to be pressed down when performing photograph- 

25 jng. A photographing mode dial 112 provided at the up- 
per part of the back surface will be described with refer- 
ence to Fig. 2. 

[0076] At the lower part of the left side surface of the 
camera 100, there are provided a universal serial bus 

so (USB) terminal 106 into which a USB cable used for 
sending image data acquired by photographing to a per- 
sonal computer is connected, and a power source input 
terminal 107 into which a power source cable used for 
supplying an external power to the camera 100 in that 

35 order from above. 

[0077] Fig. 2 is an external perspective view of the 
camera shown in Fig. 1 when it is seen obliquely down- 
wardly from the back. 

[0078] At the back surface of the camera 100, there 

40 are provided an optical finder eyepiece window 1 04b, a 
liquid crystal display (LCD) panel 108 for displaying im- 
age and a date and time, a LCD panel activation button 
109 for turning on/off image display on the LCD panel 
108, a cross key 110 to be operated when selecting a 

45 variation or zooming, a menu/OK switch 111 to be used 
when displaying a menu for setting, for example, a date 
or a date and time on the LCD panel 1 08 or determining 
the setting of the menu, a cancellation switch 116 to be 
used when canceling the setting changed by various op- 

50 erations, the photographing mode dial 112 to be used 
when selecting various modes, which will be described 
later, a function selection lever 1 1 3 to be used when se- 
lecting either a "photographing record" function for pho- 
tographing or an "image data reproduction" function for 

55 reproducing image data photographed and recorded, 
and a main switch 1 1 4 provided on the shaft of the func- 
tion selection lever 113. In the camera 100, a "first au- 
tomatic red-eye correction processing" mode or a "sec- 
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ond automatic red-eye correction processing" mode can 
be selected based on the operation of the cross key 110, 
in which a red-eye portion in a photographed object im- 
age is detected and the detected red-eye portion is cor- 
rected. The "first automatic red-eye correction process- 
ing" mode and the "second automatic red-eye correction 
processing" mode will be described in detail later. The 
LCD panel 108 is an example of each of an image dis- 
play section and a warning section according to the 
present invention. 

[0079] In the camera 1 00, the "photographing record" 
function is selected by moving the function selection le- 
ver 1 1 3 to the "photographing record" side 1 1 3a, and the 
"image data reproduction" function is selected by mov- 
ing the function selection lever 113 to the "image data 
preproduction" side 113b. When the "photographing 
record" function is selected by the function selection le- 
ver 113, any of the followings can be selected by turning 
the photographing mode dial 112: a "person photo- 
graphing" mode suitable for photographing a person, a 
"scenery photographing" mode suitable for photograph- 
ing scenery, a "sports" mode suitable for photographing 
an object moving fast, a "self timer" mode that gives time 
difference after the shutter release button 105 is 
pressed down until photographing is actually performed, 
and a "self photographing" mode suitable for photo- 
graphing the photographer himself. When no mode is 
selected, the "person photographing" mode is regarded 
as being selected when photographing is performed. 
[0080] Fig. 3 is a configuration block diagram of a sig- 
nal processing section arranged inside the camera 
shown in Figs. 1 and 2. 

[0081] The configuration of the signal processing sec- 
tion arranged in the camera 100 will be now described 
with reference to the configuration block diagram shown 
in Fig. 3. 

[0082] All processings are controlled by a CPU 211 in 
the camera 100 shown in Figs. 1 and 2. The CPU 211 
is an example of each of a photographing condition ac- 
quisition section and a control section according to the 
present invention. 

[0083] Description will be made on various switches 
first. 

[0084] The shutter release button 105 (see Figs. 1 
and 2) which directs start of photographing is provided 
with a shutter switch 1 05a which operates in synchroni- 
zation with the shutter release button 1 05 being pressed 
down. An on/off signal of the shutter switch 105a is in- 
putted into the CPU 211. The CPU 21 1 receives the on 
signal of the shutter switch 105a as a signal of starting 
photographing. At this point of time, the function selec- 
tion lever 113 has been shifted to the "photographing 
record" side 1 1 3a and it has been detected by the CPU 
211 that photographing is to be performed. 
[0085] Any one of multiple items in a selection menu 
displayed on the LCD panel 108 can be selected with 
the cross key 110. Fig. 3 shows contact points 1101 to 
1 1 04 of the cross key 1 1 0. For example, when the con- 



tact point 1101 is pressed down, the cursor moves up- 
ward. When the contact point 11 02 is pressed down, the 
cursor moves to the right. When any of the contact 
points 1101 to 1104 is connected and an on/off signal is 

5 inputted into the CPU 211, the CPU 211, based on the 
movement direction, transfers a direction to move the 
cursor to the LCD panel 108 via a bus 220. The cursor 
then moves to any of the displayed multiple items. Thus, 
the user can select any of the multiple items in the se- 

10 lection menu with the cross key 110 based on the cursor 
displayed on the LCD panel 108. In this case, if elec- 
troniczooming is selected, a partial area within the angle 
of view is cut out and electronically zoomed, with the 
center of the object to be photographed as the center 

15 for the cutting-out and zooming. It is also possible to 
specify the size of the area to be cut out. 
[0086] When the function selection lever 113 is shifted 
to the "image data production" side 113b, reproduction 
from a recording medium 240 is performed. In this case, 

20 even if a signal to direct photographing is inputted from 
the shutter switch 105a and the like, no processing is 
performed. 

[0087] Description will be now made on various ele- 
ments other than the switches. 

25 [0088] In addition to the various switches described 
above, the flash emitting device 103 shown in Fig. 1, a 
timing generator 212, a motor driver 217 for driving a 
focus lens 216, a motor driver 214 for driving a motor 
provided in a light quantity adjustment device 300, and 

30 aCDSAMP213 are connected to the CPU 211. 

[0089] When the user performs photographing, an im- 
age of an object to be photographed is displayed on the 
LCD panel 108 as it is moving. Watching the image of 
the object to be photographed, the user performs fram- 

35 jng and presses the shutter release button 105 to per- 
form photographing. In this case, by the shutter switch 
1 05a, which operates in synchronization with the shutter 
release button 105, being turned on, the CPU 211 rec- 
ognizes that a direction to start photographing has been 

40 sent by the user. In response to this, the CPU 211 out- 
puts a signal to direct emission to the flash emitting de- 
vice 103 and outputs a signal to direct start of photo- 
graphing to the timing generator 212. The flash emitting 
device 103 emits a flash in response to the emission 

45 direction. Receiving the direction to start photographing, 
the timing generator 212 supplies a signal to a CCD sol- 
id-state image pickup element 210, informing that the 
shutter release button 1 05 has been pressed down. Re- 
ceiving this signal, the CCD solid-state image pickup el- 

50 ement 210 outputs image data photographed by the 
CCD solid-state image pickup element 210 when the 
shutter release button 105 was pressed down as an 
RGB signal. The RGB signal read from the CCD solid- 
state image pickup element 210 includes a lot of noises, 

55 and therefore the CPU 211 also outputs a timing signal 
for performing a noise reduction processing to the CD- 
SAMP 213 in order to reduce the noises. 
[0090] There have been described signals outputted 
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by the CPU 211 in response to an input signal from the 
various switches shown in Figs. 1 and 2. 
[0091] It will be now described how a photographing 
signal photographed by the CCD solid-state image pick- 
up element 210 is processed in the order of steps. 
[0092] Description will be made on the case where the 
shutter release button 105 is pressed down when the 
function selection lever 113 shown in Fig. 2 is on the 
"photographing record" side 113a. 
[0093] When the function selection lever 113 connect- 
ed to the CPU 21 1 is on the "photographing record" side 
113a, if the shutter release button 105 is pressed down, 
the shutter switch 105a is connected and the CPU 211 
detects that the shutter release button 105 has been 
pressed down. In this way, when the user presses down 
the shutter release button 105, the CPU 211 directs the 
timing generator 212 to start photographing. Receiving 
the starting direction, the CCD solid-state image pickup 
element 210 outputs an RGB signal. 
[0094] Even when the shutter release button is not 
pressed down, there is always displayed an object at 
which the image taking lens is pointed, on the LCD panel 
108 of an image display device 227. The displayed ob- 
ject is acquired by converting image data consisting of 
an RGB signal, which is read from the CCD solid-state 
image pickup element 21 0 at predetermined time inter- 
vals, into a YC signal by the image signal processing 
circuit 222 and supplying the YC signal to the image dis- 
play device 227 via a video encoder 226. While such an 
object image is displayed, exposure is continuously ad- 
justed by an AE & AWB detection circuit 231 and con- 
trast is continuously detected by an AF detection circuit 
230. The image signal processing circuit 222 is an ex- 
ample of the function of a correction section, a correction 
cancellation section and a confirmation section accord- 
ing to the present invention, and detects and corrects 
red-eye portions in a photographed image when photo- 
graphing is performed, as described later. The combi- 
nation of the CPU 211 and the image signal processing 
circuit 222 is an example of each of a presumption sec- 
tion and a defect detection section according to the 
present invention. 

[0095] As for exposure adjustment, exposure is ad- 
justed by the AE & AWB detection circuit 231 based on 
brightness information in the RGB signal read from the 
CCD solid-state image pickup element 210 at predeter- 
mined time intervals. When exposure is adjusted by the 
AE & AWB detection circuit 231 , the result is sent to the 
CPU 211. The CPU 211 gives a direction to the motor 
driver 214 based on the result, and the motor provided 
in the light quantity adjustment device 300 is driven so 
that the quantity of light required for appropriate expo- 
sure can be obtained. (Hereinafter, the series of 
processings beginning with the acquisition of the bright- 
ness information until the light quantity adjustment de- 
vice 300 is adjusted to an appropriate exposure is re- 
ferred to as an exposure processing.) As for focus ad- 
justment, the focus lens 216 is moved by the AF detec- 



tion circuit 230 and contrast of the RGB signal is detect- 
ed by the AF detection circuit 230 at predetermined time 
intervals to perform focus adjustment. When contrast is 
detected by the AF detection circuit 230, the result is 

5 sent to the CPU 211. The CPU 211 directs the motor 
driver 217 to drive the focus lens 216 based on the re- 
sult, and the focus lens 216 is driven to the focused po- 
sition at which the detected contrast is maximized. 
(Hereinafter, the series of processings beginning with 

10 the detection of contrast until the focus lens 216 is ar- 
ranged at the focused position is referred to as a focus- 
ing processing.) When the focus lens 216 is arranged 
at the focused position, the CPU 211 supplies an image 
acquisition signal to thetiming generator212, the timing 

15 generator 212 supplies a photographing start signal to 
the CCD solid-state image pickup element 210, and 
electric charge accumulated in the CCD solid-state im- 
age pickup element 210 is read on the side of the CD- 
SAMP 213 as an RGB signal in response to a read sig- 

20 nal of the timing generator 212. 

[0096] At the CDSAMP 213 to which the read RGB 
signal has been supplied, a noise reduction processing 
is performed, and the noise-reduced RGB signal is sup- 
plied to an A/D conversion circuit 218. At the A/D con- 

25 version circuit 218, the analog RGB signal is A/D con- 
verted into a digital RGB signal. 

[0097] The CPU 211 is connected with an image input 
controller 219, a memory (SDRAM) 221 , the image sig- 
nal processing circuit 222, a compression processing 

so circuit 223, a medium controller 224, a USB controller 
225, the video encoder 226, the AF detection circuit 230 
and the AE & AWB detection circuit 231 via the bus 220, 
and addresses and data are sent and received via the 
bus 220. There are provided various registers for send- 

35 jng and receiving data via the bus 220, in the CPU 211 , 
and the contents of these registers are rewritten as the 
processing by each processing section progresses. The 
CPU 211 reads the contents of the registers and per- 
forms processings. 

40 [0098] The RGB signal converted into a digital signal 
is led to the bus 220 by the image input controller 219, 
controlled by the CPU 211, and written in the memory 
(SDRAM) 221 . The image input controller 219 is an ex- 
ample of an image acquisition section of the present in- 

45 vention. When acquisition of the RGB signal is complet- 
ed, the RGB signal is then read from the memory 
(SDRAM) 221 and supplied to the image signal process- 
ing circuit 222 via the bus 220. At the image signal 
processing circuit 222, the RGB signal is converted into 

50 a YC signal, and image data compressed by the com- 
pression processing circuit 223 is recorded into the re- 
cording medium 240 as a JPEG file viathe medium con- 
troller 224. 

[0099] The camera shown in Figs. 1 and 2 is also pro- 
55 vided with the USB controller 225 and configured to be 
connectable with USB-based external equipment. 
[0100] There has been described a flow of image data 
until it is recorded to the recording medium 240 when 
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photographing is performed in the camera 100 shown 
in Figs. 1 and 2. 

[0101] Fig. 4 is a flowchart showing an operational 
flow when a "first automatic red-eye correction process- 
ing" mode is selected. 

[0102] First, by selecting the "photographing record" 
function by moving the function selection lever 113 
shown in Fig. 2 to the "photographing record" side 1 1 3a, 
selecting a desired photographing mode by turning the 
photographing mode dial 112, selecting the "first auto- 
matic red-eye correction processing" mode based on 
the operation with the cross key 110; and then pressing 
down the shutter release button 105, photographing is 
performed (step S101). 

[0103] Fig. 5 shows an example of an image photo- 
graphed at step S101. 

[0104] There is shown an example of a photographed 
image with three persons 410, 420 and 430, which has 
been photographed by selecting the "person photo- 
graphing" mode with the photographing mode dial 112 
shown in Fig. 2, selecting the "first automatic red-eye 
correction processing" mode based on the operation 
with the cross key 110, and then pressing down the shut- 
ter release button 105. 

[0105] Since the "first automatic red-eye correction 
processing" mode is selected based on the operation 
with the cross key 110 shown in Fig. 2, an automatic red- 
eye correction processing is started for detecting red- 
eye portions in the image photographed and acquired 
at step S101 and correcting the detected red-eye por- 
tions (step S102). 

[0106] If red-eye portions have been detected as a re- 
sult of the detection of red-eye portions in the photo- 
graphed image performed at step S102 (step S103: 
YES), then the number of unconfirmed positions, which 
is the number of persons who have not been confirmed 
by a confirmation operation to be described later, among 
the persons on which a red-eye portion has been de- 
tected, is displayed together with a red-eye corrected 
image for which the automatic red-eye correction 
processing has been performed on the LCD panel 108 
shown in Fig. 2 (step S104). In this case, the number of 
unconfirmed positions is an example of the number of 
positions according to the present invention. 
[0107] If there is no red-eye portion detected in the 
detection of red-eye portions in the photographed image 
performed at step S102 (step S103: NO), then image 
data representing the photographed image is recorded 
to the recording medium 240 as a JPEG file via the me- 
dium controller 224 shown in Fig. 3 (step S112). 
[0108] Fig. 6 shows a display example wherein there 
are displayed a red-eye corrected image for which the 
automatic red-eye correction processing has been per- 
formed at step S1 04 and the number of unconfirmed po- 
sitions on a LCD panel. 

[0109] There is shown an example wherein a red-eye 
corrected image acquired after the automatic red-eye 
correction processing has been performed for the pho- 



tographed image shown in Fig. 5 is displayed on the 
LCD panel 108 shown in Fig. 2, with the faces 411a, 
421a and 431a of the three persons 411 , 421 and 431 , 
which have been corrected by the automatic red-eye 
5 correction processing, enclosed with a continuous circle 
510, 520 and 530 for emphasis, and at the upper left of 
the LCD panel 108, the number of unconfirmed posi- 
tions 610 is displayed, which is the number of persons 
who have not been confirmed by a confirmation opera- 
te tion to be described later, among the persons on which 
a red-eye portion has been detected. In the example 
shown in Fig. 6, "3" is displayed as the number of un- 
confirmed positions 610 at the upper left of the LCD pan- 
el 108, indicating that a red-eye portion has been de- 
15 tected and corrected for all the three persons 411 , 421 
and 431. 

[0110] Fig. 7 shows display examples different from 
Fig. 6, wherein there are displayed a red-eye corrected 
image and the number of unconfirmed positions. 

20 [0111] Though the number of unconfirmed positions 
610 in Fig. 6 is expressed in a figure, the number of un- 
confirmed positions 611 shown in Part (A) of Fig. 7 is 
expressed as a bar, and the number of unconfirmed po- 
sitions 612 shown in Part (B) is expressed as the 

25 number of dots. The number of unconfirmed positions 
can be expressed by means other than using a figure. 
[0112] If the number of unconfirmed positions at 
which a red-eye portion has been detected but not con- 
firmed is displayed together with the red-eye corrected 

30 image as described above, it is possible to easily con- 
firm the red-eye portions without overlooking any red- 
eye portion even in the case of an image in which eyes 
of multiple persons are reproduced in red as shown in 
Fig. 6 by referring to the displayed number of uncon- 

35 firmed positions. Furthermore, if faces with a red-eye 
portion in the red-eye corrected image are displayed in 
an emphasized condition, the red-eye portions in the 
red-eye corrected image can be confirmed more easily. 
[0113] If, as a result of the confirmation of the red-eye 

40 portion, with the use of the red-eye corrected image ac- 
quired afterthe automatic red-eye correction processing 
has been performed, at step S1 04, the user determines 
that the red-eye portion has been appropriately detected 
and corrected, then, by pressing down the menu/OK 

45 switch 111 shown in Fig. 2 (step S105: YES), image data 
representing the red-eye corrected image is recorded 
into the recording medium 240 as a JPEG file via the 
medium controller 224 shown in Fig. 3 (step S112). 
[0114] As described above, in the "first automatic red- 

50 eye correction processing" mode, after photographing 
has been performed by pressing down the shutter re- 
lease button 105, confirmation of red-eye portions can 
be completed only by one operation of pressing down 
the menu/OK switch 111 at step S105. Thus, red-eye 

55 portions can be confirmed extremely easily. 

[0115] If, as a result of the confirmation of the red-eye 
portion, with the use of the red-eye corrected image ac- 
quired afterthe automatic red-eye correction has been 
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performed, at step S104, the user desires to confirm a 
red-eye portion by zooming a person's face corrected 
by the automatic red-eye correction processing, then, 
by pressing down the cancellation switch 116 shown in 
Fig. 2 (step S105: NO), the face can be selected with 5 
the cross key 110 shown in Fig. 2 (step S106). 
[0116] Fig. 8 shows a display example wherein there 
is displayed a red-eye corrected image, on which a face 
can be selected with a cross key at step S 1 06, on a LCD 
panel. 10 
[0117] Fig. 8 shows an example wherein a red-eye 
corrected image is displayed on the LCD panel 108 
shown in Fig. 2, with the selected face 411a of the per- 
son 411 enclosed with a continuous-line circle 511 and 
with the faces 421a and 431a of the other persons 421 15 
and 431, which can be selected with the cross key 110 
shown in Fig. 2, enclosed with broken-line circles 521 
and 531 . The continuous-line circle 511 is moved to the 
face of another person based on the operation of the 
cross key 110 so that a desired face can be selected 20 
among the faces 411a, 421 a and 431a of the persons 
411, 421 and 431. 

[0118] Fig. 9 shows display examples different from 
Fig. 8 wherein there are displayed red-eye corrected im- 
ages on which a face can be selected at step S106. 25 
[0119] In Part (A) of Fig. 9, there is shown a display 
example wherein faces 541 , 542 and 543 corresponding 
to the faces 41 1 a, 421 a and 431a shown in Fig. 8, which 
can be selected with the cross key 110, are displayed 
as a list below the red-eye corrected image. In Part (B), so 
there is shown a display example wherein only the faces 
541 , 542 and 543 are displayed as a list without display 
of the red-eye corrected image which is shown in Part 
(A). A pointer 540 is moved based on the operation of 
the cross key 110 so that a desired face can be selected 35 
among the faces 541, 542 and 543 displayed as a list. 
Thus, by displaying the faces 541 , 542 and 543 correct- 
ed by the automatic red-eye correction processing as a 
list, the faces 541, 542 and 543 can be confirmed at a 
time. In this embodiment, description will be continued 40 
on the example wherein the red-eye corrected image is 
displayed as shown in Fig. 8 at step S106. 
[0120] After a desired person's face is selected based 
on the operation of the cross key 110 shown in Fig. 2, 
the selected person's face is zoomed on the LCD panel 45 
108 shown in Fig. 2 by pressing down the menu/OK 
switch 111 (step S107). 

[0121] Fig. 10 shows a display example wherein a 
face zoomed at step S1 07 is displayed on a LCD panel. 
[0122] There is shown an example wherein, by select- 50 
ing the face 411a of the person 411, which is enclosed 
with the continuous circle 510, in the red-eye corrected 
image shown in Fig. 8 and then pressing down the 
menu/OK switch 111, the face 411a is zoomed on the 
LCD panel 108 shown in Fig. 2. 55 
[0123] Fig. 11 shows display examples different from 
Fig. 1 0 wherein a zoomed face is displayed. 
[0124] In Part (A) of Fig. 11 , the LCD panel 108 is di- 



20 

vided into two areas 1 08_1 and 1 08_2. The red-eye cor- 
rected image is displayed in the first area 1 08_1 and the 
selected face 41 1 a is zoomed in the second area 1 08_2. 
By displaying the red-eye corrected image and the 
zoomed face side by side as described above, it is pos- 
sible to easily confirm the positions at which red-eye cor- 
rection has been performed. When there are provided 
two or more LCD panels, a photographed image may 
be displayed on one panel 1 08A and a zoomed face on 
the other panel 108B as shown in Part (B). In this em- 
bodiment, description will be made on the example 
wherein the zoomed face is displayed in a display man- 
ner as shown in Fig. 10, at step S107. 
[0125] If, as a result of the confirmation of the red-eye 
portion for which the automatic red-eye correction 
processing has been performed, with the use of the face 
zoomed at step S 1 07, the user determines that the red- 
eye portion has been appropriately detected and cor- 
rected, then, by a confirmation operation of pressing 
down the menu/OK switch 111 shown in Fig. 2 (step 
S108: YES), the automatic red-eye correction process- 
ing for the red-eye portion in the zoomed face is deter- 
mined. The process then returns to step S104, where 
the whole image is displayed on the LCD panel 108 
shown in Fig. 2. Every time the confirmation operation 
of step S108 is performed, the number of unconfirmed 
positions displayed at the upper left of the LCD panel 
108 minus 1 (one) is newly displayed as the number of 
unconfirmed positions. After that, a person other than 
the person for whom the automatic red-eye correction 
processing has been determined can be selected ac- 
cording to the same procedure as described above. 
[0126] An electronic camera in which the number of 
unconfirmed positions minus the number of confirmed 
positions makes it possible to certainly confirm red-eye 
portions in a red-eye corrected image by referring to the 
number of unconfirmed positions even if any red-eye 
portion has been overlooked. 

[0127] If, as a result of the confirmation of the red-eye 
portions for which the automatic red-eye correction 
processing has been performed, with the use of the face 
zoomed at step S1 07, the user desires to further zoom 
the eye portion of the zoomed face for confirmation, 
then, by pressing down the cancellation switch 116 
shown in Fig. 2 (step S108: NO) , the zoomed eye por- 
tion is displayed on the LCD panel 108 shown in Fig. 2 
(step S109). 

[0128] Fig. 12 shows a display example wherein an 
eye portion zoomed at step S1 09 is displayed on a LCD 
panel. 

[0129] There is shown an example wherein an eye 
portion 411b of the zoomed face 411a shown in Fig. 10 
is zoomed on the LCD panel 108 shown in Fig. 2. 
[0130] Though, in this description of embodiments, 
cases wherein both eyes are zoomed have been de- 
scribed as an example of zooming an eye portion, one 
eye may be zoomed. 

[0131] If, as a result of the confirmation of the red-eye 
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portion for which the automatic red-eye correction 
processing has been performed, with the use of the eye 
portion zoomed at step S1 09, the user determines that 
the red-eye portion has been appropriately detected and 
corrected, then, by a confirmation operation of pressing 5 
down the menu/OK switch 111 shown in Fig. 2 (step 
S110: YES), the automatic red-eye correction process- 
ing for the red-eye portion of the zoomed face is deter- 
mined. The process then returns to step S104, where 
the whole image is displayed on the LCD panel 108 10 
shown in Fig. 2. Every time the confirmation operation 
of step S110 is performed, the number of unconfirmed 
positions displayed at the upper left of the LCD panel 
1 08 minus 1 (one) is newly displayed as the number of 
unconfirmed positions. After that, a person other than 15 
the person for whom the automatic red-eye correction 
processing has been determined can be selected ac- 
cording to the same procedure as described above. 
[0132] If, as a result of the confirmation of the red-eye 
portion for which the automatic red-eye correction 20 
processing has been performed, with the use of the eye 
portion zoomed at step S1 09, the user determines that 
the red-eye portion has been inappropriately detected 
or corrected, then, by pressing down the cancellation 
switch 116 shown in Fig. 2 (step S110: NO), the detec- 25 
tion or correction of the red-eye portion for the zoomed 
eye portion is cancelled (step S111). The process re- 
turns to step S1 04, where the whole image is displayed 
on the LCD panel 108 shown in Fig. 2. Every time the 
confirmation operation of step S111 is performed, the 30 
number of unconfirmed positions displayed at the upper 
left of the LCD panel 108 minus 1 (one) is newly dis- 
played as the number of unconfirmed positions. After 
that, a person other than the person for whom the auto- 
matic red-eye correction processing has been deter- 35 
mined or cancelled can be selected according to the 
same procedure as described above. 
[0133] Though there have been described examples 
wherein detection or correction is canceled when the us- 
er determines that a red-eye portion has been inappro- 40 
priately detected or corrected, the present invention is 
not limited thereto and the corrected red-eye portion 
may be manually re-corrected. 

[0134] In the processing mode described above, red- 
eye portions in a photographed image are detected; the 45 
detected red-eye portions are corrected; and a red-eye 
corrected image acquired after the red-eye portions are 
corrected is displayed. Therefore, the detected posi- 
tions and the corrected result can be confirmed simul- 
taneously at one time with the use of the red-eye cor- 50 
rected image. Furthermore, though operationality of 
switches provided for an electronic camera are gener- 
ally not always good, red-eye portions are confirmed 
with the use of the corrected image acquired after the 
red-eye portions have been corrected in the electronic 55 
camera according to this embodiment, and accordingly 
the number of operations required for confirmation is re- 
duced, and red-eye portions in an image can be easily 



confirmed even with a low-operationality switch. 
[0135] Fig. 13 is a flowchart showing an operational 
flow when a "second automatic red-eye correction 
processing" mode is selected. 

[0136] First, by selecting the "photographing record" 
function by moving the function selection lever 113 
shown in Fig. 2 to the "photographing record" side 1 1 3a; 
selecting a desired photographing mode by turning the 
photographing mode dial 1 1 2; selecting the "second au- 
tomatic red-eye correction processing" mode based on 
the operation with the cross key 1 1 0; and then pressing 
down the shutter release button 105, photographing is 
performed (step S201). 

[0137] When photographing is performed, the CPU 
211 detects red-eye portions in a photographed image 
acquired by photographing at step S201 since the "sec- 
ond automatic red-eye correction processing" mode is 
selected based on the operation with the cross key 110 
shown in Fig. 2. The CPU then starts the automatic red- 
eye correction processing for correcting the detected 
red-eye portions (step S202). 

[0138] If red-eye portions have been detected at the 
detection of red-eyes in the photographed image at step 
S202 (step S203: YES), the number of persons on 
whom a red portion has been detected (hereinafter re- 
ferred to as the number of detections) is displayed on 
the LCD panel 108 shown in Fig. 2 together with a red- 
eye corrected image acquired after the automatic red- 
eye correction processing has been performed (step 
S204). 

[0139] If there is no red-eye portion detected in the 
detection of red-eye portions in the photographed image 
performed at step S202 (step S203: NO), then image 
data representing the photographed image is recorded 
into the recording medium 240 as a JPEG file via the 
medium controller 224 shown in Fig. 3 (step S213). 
[0140] Fig. 14 shows a display example wherein there 
are displayed a red-eye corrected image for which au- 
tomatic red-eye correction processing is performed at 
step S204 and the detected number on a LCD panel. 
[0141] There is shown an example wherein a red-eye 
corrected image acquired after the automatic red-eye 
correction processing has been performed for the pho- 
tographed image identical to the photographed image 
shown in Fig. 5, which has been acquired by photo- 
graphing the three persons 410, 420 and 430 at step 
S201 , is displayed on the LCD panel 108 shown in Fig. 
2, with the faces 411a, 421 a and 431a of the three per- 
sons 411, 421 and 431, which have been corrected by 
the automatic red-eye correction processing, enclosed 
with continuous circles 510, 520 and 530 for emphasis, 
and at the upper left of the LCD panel 1 08, the number 
of detections 620 is displayed, which is the number of 
detected red-eye portions. In the example shown in Fig. 
14, "3" is displayed as the number of detections 620 at 
the upper left of the LCD panel 108, indicating that a 
red-eye portion has been detected and corrected for all 
the three persons 411, 421 and 431 . 
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[0142] Ifthe number of detections which isthe number 
of detected red-eye portions in a red-eye corrected im- 
age is displayed together with the red-eye corrected im- 
age as described above, it is possible to easily confirm 
the red-eye portions without overlooking any red-eye 
portion even in the case of an image in which eyes of 
multiple persons are reproduced in red as shown in Fig. 
1 4 by referring to the displayed number of detected po- 
sitions. Furthermore, if faces with a red-eye portion in 
the red-eye corrected image is displayed in an empha- 
sized condition, the red-eye portions in the red-eye cor- 
rected image can be confirmed more easily. 
[0143] The CPU 211 then prioritizes the red-eye por- 
tions for which the automatic red-eye correction 
processing has been performed at step S202. In this 
embodiment, a "red-eye portion closer to the center of 
the angle of view" is given a higher priority first, and then 
a "red-eye portion with a larger area" is given a higher 
priority (step S205). 

[0144] If, after the confirmation of the red-eye por- 
tions, with the use of the red-eye corrected image ac- 
quired afterthe automatic red-eye correction processing 
has been performed, at step S204, the user does not 
perform confirmation of the red-eye portions with the 
use of an image displaying a zoomed face or eye-por- 
tion, which is to be described later, then, by pressing 
down the cancellation switch 116 shown in Fig. 2 (step 
S206: NO), image data representing the red-eye cor- 
rected image is recorded into the recording medium 240 
as a JPEG file via the medium controller 224 shown in 
Fig. 3 (step S213). 

[0145] As described above, in the "second automatic 
red-eye correction processing" mode, after photograph- 
ing has been performed by pressing down the shutter 
release button 1 05, confirmation of red-eye portions can 
be completed only by one operation of pressing down 
the cancellation switch 116 at step S206. Thus, confir- 
mation of red-eye portions can be performed very easily. 
[0146] If, as a result of the confirmation of the red-eye 
portions, with the use of the red-eye corrected image 
acquired after the automatic red-eye correction 
processing has been performed, at step S204, the user 
desires to confirm a red-eye portion by zooming the face 
of a person corrected by the automatic red-eye correc- 
tion processing, then, by pressing down the menu/OK 
switch 111 shown in Fig. 2 (step S206: YES), the face 
of a person with a red-eye portion, which has been given 
the highest priority at step S205, among the persons dis- 
played with their faces enclosed with a continuous circle 
for emphasis at step S204, is zoomed on the LCD panel 
1 08 shown in Fig. 2 together with the number of uncon- 
firmed positions (step S207). The number of uncon- 
firmed positions here is the number of the persons who 
have not been confirmed by a confirmation operation to 
be described later, among the persons on which a red- 
eye portion has been detected, similarly to the number 
of unconfirmed positions explained in the description of 
the "first automatic red-eye correction processing" 



mode, and this number of unconfirmed positions is also 
an example of the number of positions according to the 
present invention. 

[0147] An electronic camera in which the number of 

5 unconfirmed positions minus the number of confirmed 
positions is displayed makes it possible to certainly con- 
firm red-eye portions in a red-eye corrected image by 
referring to the number of unconfirmed positions even 
when any red-eye portion has been overlooked. 

w [0148] Fig. 15 shows a display example wherein a 
face zoomed at step S207 and the number of uncon- 
firmed positions are displayed on a LCD panel. 
[0149] There is shown an example wherein the face 
411a of the person 411, among the persons 411, 421 

15 and 431 with their faces 411a, 421a and 431a enclosed 
with continuous circles 51 0, 520 and 530 in red-eye cor- 
rected images shown in Fig. 14, is zoomed on the LCD 
panel 108 shown in Fig. 2, and at the upper left of the 
LCD panel 108, the number of unconfirmed positions 

20 610, which isthe number of persons who have not been 
confirmed by a confirmation operation to be described 
later, among the persons on which a red-eye portion has 
been detected, is displayed. 

[0150] If, as a result of the confirmation of the red-eye 

25 portion for which the automatic red-eye correction 
processing has been performed, with the use of the face 
zoomed at step S207, the user determines that the red- 
eye portion has been appropriately detected and cor- 
rected, then, by pressing down the menu/OK switch 1 1 1 

so shown in Fig. 2 (step S208: YES), the automatic red- 
eye correction processing for the red-eye portion in the 
zoomed face is determined. If there is any remaining 
person for whom the automatic red-eye correction 
processing has been performed and who was displayed 

35 at step S204 other than the person for whom the auto- 
matic red-eye correction has been determined (step 
S212: YES), then the face of a person with a red-eye 
portion with the highest priority among the persons ex- 
cept for the person for whom the automatic red-eye cor- 

40 rection processing has been determined is zoomed on 
the LCD panel 108 shown in Fig. 2 (step S207). Every 
time the confirmation operation of step S208 is per- 
formed, the number of unconfirmed positions 610 dis- 
played at the upper left of the LCD panel 108 minus 1 

45 (one) is newly displayed as the number of unconfirmed 
positions. 

[0151] If there is not any remaining person for whom 
the automatic red-eye correction processing has been 
performed and who was displayed at step S204 other 

50 than the person for whom the automatic red-eye correc- 
tion processing for the red-eye portion in the face 
zoomed is determined in response to the YES operation 
at S208 or canceled by a "result cancellation" mode, 
which is to be described later (step S212: NO), then im- 

55 age data representing the red-eye corrected image de- 
termined by the YES operation at step S208 or canceled 
by the "result cancellation" mode to be described later 
is recorded into the recording medium 240 as a JPEG 
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file via the medium controller 224 shown in Fig. 3 (step 
S213). 

[0152] If, as a result of the confirmation of the red-eye 
portion for which the automatic red-eye correction 
processing has been performed, with the use of the face 
zoomed at step S207, the user desires to further zoom 
the eye portion of the zoomed face for confirmation, 
then, by pressing down the cancellation switch 116 
shown in Fig. 2 (step S208: NO) , the zoomed eye por- 
tion is displayed on the LCD panel 108 shown in Fig. 2 
together with the number of unconfirmed positions (step 
S209). 

[0153] Fig. 16 shows a display example wherein an 
eye portion zoomed at S209 and the number of uncon- 
firmed positions are displayed on a LCD panel. 
[0154] There is shown an example wherein the eye 
portion 41 1 b of the zoomed face 411a shown in Fig. 1 5 
is zoomed on the LCD panel 108 shown in Fig. 2, and 
at the upper left of the LCD panel 108, the number of 
unconfirmed positions 610 is displayed, which is the 
number of persons who have not been confirmed by a 
confirmation operation to be described later, among the 
persons on which a red-eye portion has been detected. 
[0155] Though, in this description of the embodi- 
ments, cases wherein both eyes are zoomed have been 
described as an example of zooming an eye portion, one 
eye may be zoomed. 

[0156] If, as a result of the confirmation of the red-eye 
portion for which the automatic red-eye correction 
processing has been performed, with the use of the eye 
portion zoomed at step S209, the user determines that 
the red-eye portion has been appropriately detected and 
corrected, then, by a confirmation operation of pressing 
down the menu/OK switch 111 shown in Fig. 2 (step 
S210: YES), the automatic red-eye correction process- 
ing for the red-eye portion of the zoomed face is deter- 
mined. If there is any remaining person for whom the 
automatic red-eye correction processing has been per- 
formed and who was displayed at step S204 other than 
the person for whom the automatic red-eye correction 
has been determined (step S212: YES), then the face 
of a person with a red-eye portion with the highest pri- 
ority among the persons exceptforthe person for whom 
the automatic red-eye correction processing has been 
determined is zoomed on the LCD panel 108 shown in 
Fig. 2 (step S207). Every time the confirmation opera- 
tion of step S210 is performed, the number of uncon- 
firmed positions 610 displayed at the upper left of the 
LCD panel 108 minus 1 (one) is newly displayed as the 
number of unconfirmed positions. 
[0157] If there is not any remaining person for whom 
the automatic red-eye correction processing has been 
performed and who was displayed at step S204 other 
than the person for whom the automatic red-eye correc- 
tion processing for the red-eye portion in the face 
zoomed is determined in response to the YES operation 
at S210 or canceled by the "result cancellation" mode, 
which is to be described later (step S21 2: NO), then im- 



age data representing the red-eye corrected image de- 
termined by the YES operation at step S21 0 or canceled 
by the "result cancellation" mode to be described later 
is recorded into the recording medium 240 as a JPEG 
5 file via the medium controller 224 shown in Fig. 3 (step 
S213). 

[0158] The smaller the number of unconfirmed posi- 
tions becomes, the lower the priority of the red-eye por- 
tion in the zoomed face of a person is. Therefore, if it is 

10 determined that the red-eye portion in the zoomed face 
is no more important after repeating the series of 
processings from step S207 to step S212, then the user 
can proceed to step S213 from the step S212 to record 
the red-eye corrected image by pressing down the can- 

15 cellation switch 116 shown in Fig. 2. 

[0159] If, as a result of the confirmation of the red-eye 
portion for which the automatic red-eye correction 
processing has been performed, with the use of the eye 
portion zoomed at step S209, the user determines that 

20 the red-eye portion has been inappropriately detected 
or corrected, then, the user presses down the cancella- 
tion switch 116 shown in Fig. 2 (step S210: NO) 
[0160] When selecting the "second automatic red-eye 
correction processing" mode for the camera 100 of this 

25 embodiment to perform photographing, it is assumed 
that either the "result cancellation" mode for canceling 
detection or correction of a red-eye portion in a zoomed 
eye portion orthe "correction" mode for enabling manual 
re-correction of the red-portion in the zoomed eye has 

30 been selected and set in advance. When either mode is 
set in advance, pressing down the cancellation switch 
1 1 6 as the NO operation at step S21 0 causes automatic 
shift to the mode set in advance. 

[0161] When the "result cancellation" mode is set, de- 

35 tection or correction of the red-eye portion in a zoomed 
eye is cancelled if the cancellation switch 1 1 6 is pressed 
down as the NO operation at step S210 (step S211). If 
there is any remaining person for whom the automatic 
red-eye correction processing has been performed and 

40 who was displayed at step S204 other than the person 
for whom the automatic red-eye correction has been 
canceled (step S212: YES) , then the face of a person 
with a red-eye portion with the highest priority among 
the persons except for the person for whom the auto- 

45 matic red-eye correction processing has been deter- 
mined is zoomed on the LCD panel 1 08 shown in Fig. 2 
(step S207). Every time the confirmation operation of 
step S21 1 is performed, the number of unconfirmed po- 
sitions 610 displayed at the upper left of the LCD panel 

50 108 minus 1 (one) is newly displayed as the number of 
unconfirmed positions. 

[0162] If the automatic red-eye correction processing 
for the red-eye portion in the zoomed face is cancelled 
at step S211 , or if there is not any remaining person for 
55 whom the automatic red-eye correction processing has 
been performed and who was displayed at step S204 
other than the person for whom determination has been 
performed by the confirmation operation described 
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above (step S212: NO), then image data representing 
the red-eye corrected image cancelled at step S211 or 
determined by the confirmation operation described 
above is stored in the recording medium 240 as a JPEG 
file via the medium controller 224 shown in Fig. 3 (step 
S213). 

[0163] When the "correction" mode is selected, inap- 
propriate detection or correction such as displacement 
and unsuitable size can be manually re-corrected by 
pressing down the cancellation switch 116 as the NO 
operation at step S210. 

[0164] In the first embodiment, there have been de- 
scribed examples wherein the red-eye correction 
processing and the work for confirming the processing 
is performed immediately after photographing. Howev- 
er, the series of processings including acquisition of a 
photographed image, red-eye correction processing 
and display of a corrected image may be performed for 
multiple photographed images and the work for confirm- 
ing them may be collectively performed later, in an im- 
age correction apparatus and an image pickup appara- 
tus of the present invention. When only the work of con- 
firming the red-eye correction processing is performed 
for images collectively later, both of the original photo- 
graphed images and corrected images for which the 
red-eye correction has been performed are stored, and 
unnecessary images are deleted after the confirmation 
work. In this case, only a part of an image, where a de- 
fect has occurred, may be stored instead of storing the 
whole image. Alternatively, correction information may 
be stored instead of an image. Having a smaller data 
size than an image, the correction information is advan- 
tageous in that it does not put much pressure on the 
capacity of a recording medium. As a method for storing 
the correction information, it is conceivable to embed the 
correction information into an eye portion where a defect 
has occurred as a tag information, into a margin portion 
where no image is arranged, or into the image as an 
electronic watermark. 

[0165] The description of the first embodiment ac- 
cording to the present invention has been completed. A 
second embodiment of the present invention will be now 
described. A camera of this embodiment has a config- 
uration similar to that of the camera 1 00 of the first em- 
bodiment shown in Figs. 1 to 3. Figs. 1 to 3 are also used 
to describe this embodiment, and only differences from 
the first embodiment are described. 
[0166] Fig. 17 is a flowchart showing a series of 
processings from photographing of an object with a 
camera according to a second embodiment to storage 
of a photographed image. 

[0167] Similarly to the first embodiment, when the us- 
er adjusts the function selection lever 113 as shown in 
Fig. 2 to the "photographing record" side 113a first, a 
photographed object image is roughly read at predeter- 
mined time intervals by the CCD solid-state image pick- 
up element 21 0 shown in Fig. 3, an RGB signal is out- 
putted, and then the series of exposure processing and 



focusing processing are performed (pre-photographing 
at step S301). 

[0168] The operator selects a mode ("person photo- 
graphing" mode, "scenery photographing" mode, 

5 "sports" mode, "self timer" mode and "self photograph- 
ing" mode) using the photographing mode dial 112 
shown in Fig. 2. Furthermore, when performing flash 
photographing accompanied by a flash, a flash button 
(not shown) is pressed down to specify flash photo- 

10 graphing. The pressed down condition of the photo- 
graphing mode dial 112 and the flash button is sent to 
the CPU 211. 

[0169] If the flash button is not pressed down (step 
S302: NO), then it is presumed that a red-eye defect will 
15 not occur in a photographed image in the CPU 211 , and 
the process proceeds to step S311 from step S302 in 
the flowchart of Fig. 17. 

[0170] When the user presses down the shutter re- 
lease button 105, the CPU 211 detects the shutter re- 

20 lease button 105 being pressed down. The CPU 211 di- 
rects the timing generator 212 to start photographing 
and the photographed object image is read in detail by 
the CCD solid-state image pickup element 210 to per- 
form the photographing processing similar to that per- 

25 formed at step S101 in Fig. 4 is performed (step S311). 
[0171] The image signal processing circuit 222 per- 
forms a predetermined image processing, such as a 
gradation correction processing, for image data ac- 
quired by photographing. The image data for which the 

so image processing has been performed is recorded into 
the recording medium 240 (step S313 in Fig. 17). Since 
the image processing such as a gradation correction 
processing has been traditionally broadly performed, 
description thereof is omitted herein. 

35 [0172] Eye-related defects such as red-eyes usually 
do not occur easily when flash photographing is not per- 
formed. Accordingly, when flash photographing is not 
performed, it is possible to speed up processings by 
omitting the red-eye correction processing. 

40 [0173] If the user presses down the flash button (step 
S302: YES) and a mode other than the "person photo- 
graphing" mode is selected (step S303: NO), then the 
CPU 211 also presumes that a red-eye defect will not 
occur in a photographed image, and the process then 

45 proceeds to step S311 from step S303 in the flowchart 
to perform photographing. 

[0174] If the user presses down the flash button (step 
S302: YES), the "person photographing" mode is select- 
ed (step S303: YES), and the distance to the vicinity of 

50 the center of the angle of view (distance to the object), 
which is calculated by the focusing processing during 
the pre-photographing at step S301 , is beyond a prede- 
termined range (step S304: NO), then the CPU 211 also 
presumes that a red-eye defect will not occur in a pho- 

55 tographed image, and the process then proceeds to 
step S311 from step S304 in the flowchart to perform 
photographing. 

[0175] When the distance to the object is beyond a 
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predetermined range, for example, when it is too short 
or too long, the possibility that a red-eye defect occurs 
is low even if there is a person in a photographed image. 
In this embodiment, when a mode otherthan the "person 
photographing" mode ("scenery photographing" mode, 
"sports" mode, "self timer" mode or "self photographing" 
mode) is selected as the mode, it is presumed that there 
is no person in a photographed image or that the dis- 
tance to the object is beyond a predetermined range 
even if there is any person photographed, and therefore 
the red-eye correction processing is omitted. In this em- 
bodiment, the "person photographing" mode is initially 
selected. Therefore, if the user performs photographing 
without regard to the mode, the "person photographing" 
mode is selected (step S303: YES) and photographing 
that prevents red-eye defect from occurring, which will 
be described later, is performed. In the case of a camera 
for which a mode otherthan the "person photographing" 
mode is initially selected or a camera with an auto mode 
in which the camera automatically selects a suitable 
mode, if either the condition that '"the person photo- 
graphing" mode is selected (step S303)" orthe condition 
that "the distance to the object is within a predetermined 
range (step S304)" is true, then the process may pro- 
ceed to the photographing process at and after step 
S305 for preventing a red-eye defect from occurring. 
[0176] If the user presses down the flash button (step 
S302: YES), the "person photographing" mode is select- 
ed as the mode (step S303: YES), and the distance to 
the object is within a predetermined range (step S304: 
YES), then the CPU 211 presumes that a red-eye defect 
will occur in a photographed image. In this case, the 
CPU 211 causes a warning to be disaplayed on the LCD 
panel 1 08 shown in Fig. 2, indicating that "a red-eye will 
occur" (step S305). By receiving the warning, the user 
can certainly recognize that "a red-eye may occur". 
[0177] Furthermore, the CPU 211 directs the flash 
emitting device 103 shown in Fig. 3 to adjust the emis- 
sion strength and the emission period of the flash emit- 
ting device 1 03 to predetermined values at which a red- 
eye will not easily occur (step S306). 
[0178] When the flash emitting device 103 has been 
adjusted and the user presses down the shutter release 
button 1 05, the CPU 211 detects the shutter release but- 
ton 105 being pressed down and performs a photo- 
graphing processing accompanied by a flash (step 
S307). In image data acquired by the photographing 
process at step S307, red-eyes are prevented from oc- 
curring. 

[0179] The CPU 211 directs the CDSAMP 21 3 to ad- 
just the gain of an amplifier (step S308). 
[0180] The image processing similar to that per- 
formed at step S312 is performed for the image data 
acquired by photographing (step S309), and the image 
data for which the image processing has been per- 
formed is recorded into the recording medium 240 (step 
S310). 

[0181] By making a presumption on whether or not a 



defect such as red-eyes will occur in advance based on 
photographing conditions such as a photographing 
mode, with or without a flash, distance to the object and 
the like, and adjusting emission of the flash emitting de- 

5 vice when it is presumed that a defect will occur, occur- 
rence of red-eyes can be reduced. 
[0182] In this embodiment, occurrence of red-eyes is 
reduced and therefore confirmation of photographed im- 
ages is not performed. However, if a warning is issued, 

10 confirmation may be performed to make sure. 

[0183] The description of the second embodiment ac- 
cording to the present invention has been completed. A 
third embodiment of the present invention will be now 
described. A camera of this embodiment also has a con- 

15 figuration similar to that of the camera 100 of the first 
embodiment shown in Figs. 1 to 3. Figs. 1 to 3 are also 
used to describe this embodiment, and only differences 
between the first and second embodiments are de- 
scribed. 

20 [0184] In the camera of this embodiment, the shutter 
release button 1 05 shown in Fig. 1 can be pressed down 
at two stages. By pressing the button at the first stage, 
the pre-photographing (the exposure processing and 
the focusing processing) is performed. By pressing the 

25 button at the second stage, the actual photographing 
processing is performed. 

[0185] Fig. 18 is a flowchart showing a series of 
processings from photographing of an object with a 
camera according to the third embodiment to storage of 

30 a photographed image. 

[0186] First, the user selects a mode ("person photo- 
graphing" mode, "scenery photographing" mode, 
"sports" mode, "self timer" mode and "self photograph- 
ing" mode) using the photographing mode dial 112 

35 shown in Fig. 2. Furthermore, when performing flash 
photographing accompanied by a flash, the user press- 
es down a flash button (not shown) to specify flash pho- 
tographing. Furthermore, when performing the automat- 
ic red-eye correction processing, the user selects the 

40 "automatic red-eye correction processing" mode (for de- 
tecting red-eye portions in a photographed object image 
and correcting the detected red-eye portions) with the 
cross key 110. The setting condition of the cross key 
1 1 0, the photographing mode dial 1 1 2 and the flash but- 

45 ton is sent to the CPU 211. 

[0187] The user then points the camera to a desired 
objectto be photographed and presses down the shutter 
release button 1 05 at the first stage (step S401 ). 
[0188] If flash photographing is not selected with the 

50 flash button (step S402 in Fig. 18: NO), the photograph- 
ing processing not accompanied by a flash, similar to 
that performed at step S310 in Fig. 17, is performed 
(step S411), and image data acquired by the photo- 
graphing processing is recorded into the recording me- 

55 dium 240 (step S410). Eye-related defects such as red- 
eyes seldom occur in an image photographed without a 
flash, and therefore the red-eye correction processing 
can be omitted. 
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[0189] If flash photographing is selected with the flash 
button (step S402 in Fig. 1 8: YES) , the pre-photograph- 
ing similar to that performed at step S301 in Fig. 17 is 
performed inside the camera, and image data with 
rough pixels (hereinafter referred to as low-resolution 
data) is acquired without a flash from the flash emitting 
device 103 (step S403). This low-resolution data is an 
example of first image data according to the present in- 
vention, and a low-resolution image represented by the 
low resolution data is an example of a first image ac- 
cording to the present invention. 

[0190] The user then presses down the shutter re- 
lease button 105 at the second stage to direct photo- 
graphing (step S404). 

[0191] The photographing processing accompanied 
by a flash, similar to that performed at step S307 in Fig. 
7, is performed inside the camera, and image data with 
fine pixels (hereinafter referred to as high-resolution da- 
ta) is acquired (step S405.) The high-resolution data is 
an example of second resolution data according to the 
present invention, and a high-resolution image repre- 
sented by the high-resolution data is an example of a 
second image according to the present invention. 
[0192] If the "automatic red-eye correction process- 
ing" mode is not selected (step S406: NO), the red-eye 
correction processing is not performed, and the ac- 
quired high-resolution data is recorded into the record- 
ing medium 240 (step S410). 

[0193] If the "automatic red-eye correction process- 
ing" mode is selected (step S406: YES), the image sig- 
nal processing circuit 222 compares colors in the low- 
resolution image represented by the low-resolution data 
acquired at step S403 and colors in the high-resolution 
image represented by the high-resolution data acquired 
at step S405 (step S407). In this embodiment, hue dif- 
ference between the high-resolution image and the low- 
resolution image is acquired by the image signal 
processing circuit 222. 

[0194] If the hue difference acquired at step S407 is 
below a predetermined value (step S408: NO), it is pre- 
sumed that there is no red-eye caused in the high-res- 
olution image, the high-resolution image data is record- 
ed into the recording medium 240 without the red-eye 
correction processing being performed by the image 
signal processing circuit 222 (step S41 0). Since the low- 
resolution image has been acquired without a flash, the 
possibility of occurrence of red-eyes is low. On the other 
hand, the high-resolution image has been acquired with 
a flash, and therefore possibility of occurrence of red- 
eyes is high. However, the difference between the colors 
of the high-resolution image and those of the low-reso- 
lution image is below the predetermined value, it is de- 
termined that no red-eye has been occurred. 
[0195] If the hue difference acquired at step S407 is 
equal to or above the predetermined value (step S408: 
YES), the image signal processing circuit 222 considers 
that a defect has occurred at positions in the high-res- 
olution image at which the hue difference is equal to or 



above the predetermined value. If the lightness differ- 
ence at a position in the high-resolution image at which 
a defect has occurred is significantly different from that 
in the part around the position, the defect at the position 

5 can be considered to be a gold-eye defect, and the hue 
difference or the saturation difference at the position is 
significantly different from that in the part around the po- 
sition, the defect at the position can be considered to be 
a red-eye defect. 

w [0196] When a defect is detected, the automatic red- 
eye correction processing similar to that performed at 
step S102 in Fig. 4 is performed for the high-resolution 
data (step S409). After confirmation is performed for the 
red-eye portions, the image data for which the automatic 

15 r ed-eye correction processing has been performed is re- 
corded into the recording medium 240 (step S410). 
[0197] By performing the red-eye correction process- 
ing only when it is presumed in advance that a red-eye 
defect will occur in a photographed image, the burden 

20 of processing can be reduced and the confirmation work 
for red-eye corrected images can be also reduced. 
[0198] Though, this embodiment has been described 
with an example wherein the present invention is ap- 
plied to an electronic camera in which an image of a pho- 

25 tographed object is focused on a CCD solid-state image 
pickup element to acquire image data representing the 
photograph object as a signal, the present invention is 
not limited thereto. The present invention can also be 
applied to an image correction apparatus for detecting 

30 a particular eye-related defect in an image represented 
by acquired image data, correcting the detected defect 
and displaying the number of positions at which the de- 
fect has been detected together with the image including 
the positions, which is realized, for example, by a per- 

35 sonal computer. 

[0199] Though, in this description of the embodi- 
ments, there have been shown examples wherein the 
automatic red-eye correction processing is performed 
in response to the "first automatic red-eye correction 

40 processing" mode or the "second automatic red-eye 
correction processing" mode being selected, the auto- 
matic red-eye correction processing may be always per- 
formed after photographing or after photographing with 
a flash. 

45 [0200] In the above description, there have been 
shown examples wherein the red-eye correction 
processing and the work for confirming the processing 
are performed immediately after photographing. How- 
ever, in an image correction apparatus and an image 

50 pickup apparatus of the present invention, multiple pho- 
tographed images may be acquired first, and the red- 
eye correction processing and the work for confirming 
the processing may be performed for the images collec- 
tively later. When only the work for confirming the red- 

55 eye correction processing is performed for images col- 
lectively, both of the original photographed images and 
corrected images for which the red-eye correction has 
been performed are stored and unnecessary images 



17 



33 



EP 1 429 290 A2 



34 



are deleted after the confirmation work. In this case, in- 
stead of storing the whole image, only a part of the im- 
age where a defect has occurred may be stored. Alter- 
natively, correction information may be stored instead 
of an image. 5 
[0201] There was described an example wherein a 
warning to the effect that a defect will occur is displayed 
on the image display section. However, a warning ac- 
cording to the present invention may be displayed on a 
finder and the like which the user looks into. 10 
[0202] There was described an example wherein a 
warning to the effect that a defect will occur is displayed 
on an image display section. However, a warning ac- 
cording to the present invention may be issued by voice. 
[0203] There was described an example of a warning 15 
section for issuing a warning to the effect that a defect 
will occur. However, a warning section according to the 
present invention may issue a notification to the effect 
that the correction processing will work in conjunction 
with a photographing mode, for example, when the au- 20 
tomatic red-eye correction processing mode is set, or 
may issue an advice to set the automatic red-eye cor- 
rection processing mode when flash photographing is 
set without setting the automatic red-eye correction 
processing mode. 25 
[0204] There was described an example wherein a 
presumption is made on whether or not a defect has oc- 
curred in a photographed image based on difference be- 
tween colors in a first image acquired without a flash 
and colors in a second image acquired with a flash. 30 
However, an image correction apparatus and an image 
pickup apparatus according to the present invention 
may emit a flash even during pre-photographing and de- 
tect red-eyes or issue a warning based on low-resolution 
data acquired by the pre-photographing. By detecting 35 
red-eyes with the use of low-resolution data acquired by 
pre-photographing, the processings are distributed and 
time required for the red-eye correction processing after 
actual photographing can be shortened. 
[0205] In this description of the embodiments, there 40 
have been described examples wherein red-eye por- 
tions in a photographed image are detected and the de- 
tected red-eye portions are corrected, the present in- 
vention is not limited thereto, and a particular eye-relat- 
ed defect, such as a gold-eye portion, may be detected 45 
and the detected defect may be corrected. 
[0206] In this description of the embodiments, "the 
number of unconfirmed positions" indicating the number 
of persons for whom a red-eye portion has been detect- 
ed is shown as an example of "the number of positions". 50 
However, "the number of positions" according to the 
present invention may be, for example, the number of 
eyes for which a defect such as a red-eye portion has 
been detected. 

[0207] There was described an example wherein the 55 
number of positions at which a defect has been detected 
is displayed. However, an image display section accord- 
ing to the present invention may display, for each of lev- 



els of a defect, the number of positions at which the de- 
fect of the level has occurred. 

[0208] In this description of the embodiments, there 
have been used examles wherein the number of posi- 
tions in a photographed image at which a red-portion 
has been detected is displayed together with a red-eye 
corrected image including the positions, which has been 
acquired after the red-eye portions in the photographed 
image have been detected and corrected. However, the 
present invention is not limited thereto, and the number 
of positions in a photographed image at which a red-eye 
portion has been detected may be displayed together 
with the photographed image including the positions, 
which has been acquired before the red-eye portions in 
the photographed image have been detected and cor- 
rected. 



Claims 

1. An image correction apparatus comprising: 

an image acquisition section that acquires im- 
age data representing an image; 
a correction section that detects a particular 
eye-related defect in the image represented by 
the image data acquired by the image acquisi- 
tion section and corrects the detected defect; 
and 

an image display section that displays the 
number of positions at which the defect has 
been detected by the correction section, to- 
gether with the image including the positions. 

2. The image correction apparatus according to claim 
1, wherein the correction section not only detects 
the defect in the image but also prioritizes the posi- 
tions at which the defect has been found based on 
a predetermined criteria, and 

wherein the image display section, when dis- 
playing the image, displays in preference a po- 
sition to which a higher priority has been given 
by the correction section. 

3. The image correction apparatus according to claim 
1 , wherein the image display section, when display- 
ing the image, displays a list of the positions. 

4. The image correction apparatus according to claim 
1 , wherein the image display section, when display- 
ing the image, zooms at least one of the positions. 

5. The image correction apparatus according to claim 
4, wherein the image display section, when display- 
ing the image, displays a normal image in which 
none of the positions is zoomed and a zoomed im- 
age in which at least one of the positions is zoomed. 
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6. The image correction apparatus according to claim 
1 , further comprising a confirmation section that re- 
ceives an operation for confirming the positions in 
the image displayed by the image display section, 
at which the defect has been detected by the cor- 5 
rection section, 



7. The image correction apparatus according to claim 

1, wherein the correction section detects red-eye 15 
portions in the image and corrects the detected red- 
eye portions. 

8. An image correction apparatus comprising: 

20 

an image acquisition section that acquires im- 
age data representing an image; 
a correction section that detects an eye-related 
defect in the image represented by the image 
data acquired by the image acquisition section 25 
and corrects the detected defect; and 
an image display section that displays an image 
based on the image data, 
wherein the image display section, when the 
image data is acquired by the image acquisition 30 
section, displays a corrected image in which the 
defect has been corrected by the correction 
section. 

9. The image correction apparatus according to claim 35 
8, wherein the correction section not only detects 

the defect in the image but also prioritizes positions 
at which the defect has been found based on a pre- 
determined criteria, and 

40 

wherein the image display section, when dis- 
playing the corrected image, displays in prefer- 
ence a position to which a higher priority has 
been given by the correction section. 

45 

10. The image correction apparatus according to claim 
8, wherein the image display section, when display- 
ing the corrected image, displays a list of positions 
at which the defect has been detected by the cor- 
rection section. 50 

1 1 . The image correction apparatus according to claim 
8, wherein the image display section, when display- 
ing the corrected image, displays a normal image 

in which none of the positions at which the defect 55 
has been detected by the correction section is 
zoomed and a zoomed image in which at least one 
of the positions is zoomed. 



12. The image correction apparatus according to claim 
8, further comprising a correction cancellation sec- 
tion that restores the defect corrected by the cor- 
rection section, in the corrected image displayed by 
the image display section, to the original condition 
held before the defect is corrected by the correction 
section. 

13. The image correction apparatus according to claim 
8, wherein the image display section, when display- 
ing the corrected image, emphasizes the defect cor- 
rected by the correction section. 

14. The image correction apparatus according to claim 
8, wherein the correction section detects red-eye 
portions in the image and corrects the detected red- 
eye portions, and 

wherein the image display section, when the 
image data is acquired by the image acquisition 
section, displays a corrected i mage in which the 
red-eye portions have been corrected by the 
correction section. 

15. An image pickup apparatus that forms a photo- 
graphed object image by light of the photographed 
object sent via a photographing optical system onto 
a solid-state image pickup element to acquire im- 
age data representing the photographed object im- 
age; the image pickup apparatus comprising: 

a correction section that detects a particular 
eye-related defect in the photographed object 
image and corrects the detected defect; and 
an image display section that displays an image 
including positions at which the defect has been 
detected by the correction section and displays 
the number of the positions at which the defect 
has been detected. 

16. An image pickup apparatus that forms a photo- 
graphed object image by light of the photographed 
object sent via a photographing optical system onto 
a solid-state image pickup element to acquire im- 
age data representing the photographed object im- 
age; the image pickup apparatus comprising: 

an image display section that displays an image 
based on image data; and 
a correction section that detects an eye-related 
defect in the photographed object image and 
corrects the detected defect, 
wherein the image display section, when the 
image data representing the photographed ob- 
ject image is acquired, displays a corrected im- 
age in which the defect has been corrected by 
the correction section. 



wherein the image display section, when dis- 
playing the number of the positions, displays 
the number of the positions minus the number 10 
of positions confirmed by the confirmation sec- 
tion. 
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17. An image pickup apparatus comprising: 

an image pickup section that forms a photo- 
graphed object image by light of the photo- 
graphed objectsentvia a photographing optical 5 
system onto a solid-state image pickup element 
to acquire image data representing the photo- 
graphed object; 

a photographing condition acquisition section 
that acquires photographing conditions in pho- 10 
tographing an object to be photographed; 
a presumption section that makes a presump- 
tion on whether or not a particular eye-related 
defect is to occur in the photographed object 
image represented by the image data acquired 15 
by the image pickup section, based on the pho- 
tographing conditions acquired by the photo- 
graphing condition acquisition section. 

18. The image pickup apparatus according to claim 17, 20 
further comprising: 

a flash emitting section that emits a flash in syn- 
chronization with photographing performed by 
the image pickup section; and 25 
a control section that controls emission per- 
formed by the flash emitting section based on 
the result of the presumption by the presump- 
tion section. 

30 

19. The image pickup apparatus according to claim 17, 
further comprising a correction section that detects 
the particular eye-related defect in the photo- 
graphed object image and corrects the detected de- 
fect when it is presumed by the presumption section 35 
that the defect is to occur. 

20. The image pickup apparatus according to claim 17, 
further comprising a warning section that issues a 
warning indicating that the defect is to occur when 40 
it is presumed by the presumption section that the 
defect is to occur. 

21 . The image pickup apparatus according to claim 17, 
further comprising a flash emitting section that 45 
emits a flash, 

wherein the image pickup section acquires first 
image data by avoiding the flash emitted by the 
flash emitting section and acquires second im- 50 
age data in synchronization with the flash emit- 
ted by the flash emitting section, and 
wherein the presumption section comprises a 
defect detection section that compares colors 
in a first image represented by the first image 55 
data and colors in a second image represented 
by the second image data and considers the 
defect to have occurred at positions where the 



colors are different to the degree equal to or ex- 
ceeding a predetermined level. 
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